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DEPARTMENT  OF  HEALTH, 
EDUCATION.  AND  WELFARE 

Office  of  Education 

45  CFR  Parts  116  and  116a 

Financial  Assistance  to  Local 
Educational  Agencies  To  Meet  the 
Special  Educational  Needs  of 
Educationally  Deprived  and  Neglected 
and  Delinquent  Children— Evaluation 
Requirements 

agency:  Office  of  Education.  HEW. 
action:  Final  Regulations. 

summary:  These  final  regulations 
govern  the  evaluation  of  programs  and 
projects  authorized  by  title  I  of  the 
Elementary  and  Secondary  Education 
Act  of  1965.  The  regulations  are  required 
by  the  Education  Amendments  of  1974 
and  1978.  For  projects  conducted  by 
local  educational  agencies  (LEAs),  the 
regulations  provide  evaluation 
standards  and  amend  existing 
requirements  governing  frequency.of 
evaluation.  These  regulations  also 
specify  models  for  evaluating  the 
effectiveness  of  LEA  projects  providing 
instructional  services  in  reading, 
language  arts,  or  mathematics.  Other 
title  I  requirements  resulting  from  the 
Education  Amendments  of  1978  were 
published  as  a  Notice  of  Proposed 
Rulemaking  on  June  29. 1979  (44  FR 
38400). 

EFFECTIVE  DATE:  These  regulations  are 
expected  to  take  effect  45  days  after 
they  are  transmitted  to  the  Congress. 
They  are  transmitted  to  the  Congress 
several  days  before  they  are  published 
in  the  Federal  Register.  The  effective 
date  is  changed  by  statute  if  Congress 
disapproves  the  regulations  or  takes 
certain  adjournments.  If  you  want  to 
know  the  effective  date  of  these 
regulations,  call  or  write  the  Office  of 
Education  contact  person. 

FOR  FURTHER  INFORMATION  CONTACT: 

Dr.  Judith  Burnes.  Office  of  Evaluation 
and  Dissemination.  U.S.  Office  of 
Education.  Room  3040,  FOB  6.  400 
Maryland  Avenue.  SW.,  W'ashington, 

D  C.' 20202.  Telephone:  202-245-8364. 
SUPPLEMENTARY  INFORMATION:  A  Notice 
of  Proposed  Rulemaking  published  in 
the  Federal  Register  on  February  7, 1979 
(44  FR  7914)  proposed  to  amend  parts 
116  and  116(a)  of  45  CFR  to  implement 
certain  evaluation  requirements 
resulting  from  the  Education 
Amendments  of  1974  and  1978.  The 
regulations  specify  models  and 
standards  for  the  evaluation  of  projects 
conducted  by  LEAs^ 


Several  changes  in  the  final 
regulations  resulted  from  comments 
received  in  response  to  the  proposed 
rules.  These  include  a  change  in  the 
deadline  for  the  State  evaluation  refmrt 
the  inclusion  in  the  biennial  report  of 
data  from  projects  conducted  since  the 
last  report,  the  elimination  of  a 
requirement  for  sending  two  local 
reports  to  the  Office  of  Education,  the 
reduction  of  reported  project  data  to 
cover  a  sample  of  grades,  and  the  use  of 
title  I  funds  for  required  long-teim 
evaluations.  Other  issues  raised  by  the 
commenters  included  the  appropriate 
requirements  for  long-term  evaluations, 
v^hether  “language  arts"  programs 
include  programs  to  teach  English  to 
non-English  speaking  children,  and  how 
data  resulting  from  the  models  will  be 
used  at  the  local.  State,  and  national 
levels. 

The  required  evaluation  models 
represent  an  improvement  over  the 
practices  and  procedures  of  many 
locally  conducted  title  I  evaluations. 
Technical  questions  remain,  however, 
concerning  such  issues  as  the  extent  to 
which  the  different  models  yield 
comparable  data.  These  issues  are 
currently  under  investigation  by  the 
Office  of  Education.  As  further  technical 
analysis  leads  to  refinements  in  either 
the  models  or  the  process  for  reporting 
evaluation  results,  revisions  in  the 
regulations  may  be  needed.  The 
Commissioner  intends  to  reconsider, 
and  if  necessary,  revise  the  regulations 
after  a  three-year  period,  based  on 
information  available  at  that  time. 
Representatives  of  State  educational 
agencies  (SEAs)  and  LEAs  will  be 
invited  to  participate  in  this  review. 

Evaluation  activities  in  title  I  have 
several  purposes.  They  include  an 
assessment  of  the  effectiveness  of  title  I 
services  and.  for  the  purpose  of  revision 
and  improvement,  the  identification  of 
strengtns  and  weaknesses  of  individual 
projects.  Although  the  required  models 
are  concerned  with  only  the  most 
common  titie  I  objectives — achievement 
gains  in  reading,  language  arts,  and 
mathematics — SEAs  and  LEAs  are 
encouraged  to  evaluate  all  of  their 
project  objectives  and  to  collect 
whatever  data  are  needed  for  local 
decision  making. 

Section  187  requires  the 
Commissioner  to  publish  a  title  I  policy 
manual.  The  manual  will  provide  policy 
guidance  concerning  the  evaluation 
requirements.  A  draft  of  the  evaluation 
section  of  the  policy  manual  is  currently 
available  and  may  be  obtained  by 
WTiting  to  the  address  at  the  beginning 
of  this  document.  Detailed  procedures 
for  implementing  each  of  the  models  are 


contained  in  a  User’s  Guide,  also 
available  from  that  address. 

In  addition,  a  technical  assistance 
center  has  been  established  in  each 
HEW  region  to  assist  SEAs  and  LEAs 
with  title  I  evaluation  matters. 

During  March  of  1979  the 
Commissioner  held  public  meetings  on 
the  proposed  regulations  in  Boston, 
Mass.:  Atlanta,  Georgia;  Kansas  City, 
Missouri;  and  San  Francisco.  California. 
Interested  parties  were  also  given  45 
days  to  make  written  comments  on  the 
proposed  regulations.  The  Appendix 
summarizes  the  comments  received  and 
the  Commissioner’s  responses  to  them. 

Citation  of  Legal  Authority 

The  reader  will  find  a  citation  of 
statutory  or  other  legal  authority  in 
parentheses  on  the  line  following  each 
substantive  provision. 

(Catalog  of  Federal  Domestic  Assistanf:e 
Number  13.428.  Educationally  Deprived 
Children — Local  Educational  Agencies) 

Dated;  August  1,  1979. 

Mary  F.  Berry, 

Actinf’  U.S.  Coniniissioiierof  Edaratum 

Approved:  October  5. 1979. 

Patricia  Roberts  Harris. 

Secretary  of  Health.  Education,  and  Welfare. 

The  Commissioner  amends  Parts  116 
and  116a  of  45  CFR  to  read  as  follows: 

PART  116— FINANCIAL  ASSISTANCE 
TO  LOCAL  EDUCATIONAL  AGENCIES 
AND  STATE  AGENCIES  TO  MEET  THE 
SPECIAL  EDUCATIONAL  NEEDS  OF 
EDUCATIONALLY  DEPRIVED, 
HANDICAPPED,  MIGRANT,  AND 
NEGLECTED  AND  DELINQUENT 
CHILDREN— GENERAL  PROVISIONS 

Subpart  B— Duties  and  Functions  of 
State  Educational  Agencies 

1.  Section  116.7  is  amended  by 
revising  paragraph  (a)  as  follows: 

§  1 16.7  Reports  by  State  educational 
agencies. 

(a)  Evaluation  reports.  The  SEA  shall 
submit  to  the  Commissioner  a  report 
evaluating  the  effectiveness  of  title  I 
programs  and  projects  in  meeting  the 
special  educational  needs  of 
participating  children.  This  report  must 
contain  information  about  programs  and 
projects  conducted  since  the  last  report. 

(1)  For  programs  and  projects 
authorized  by  part  B,  subparts  1,  2.  and  3 
(State  programs  for  migratory  children, 
for  handicapped  children,  and  for 
neglected  or  delinquent  children),  this 
report  is  due  on  February  1  of  each  year. 

(2)  For  programs  and  projects 
authorized  by  part  A.  subpart  1  (basic 
grants  to  local  educational  agencies), 
this  report  is  due  on  February  1, 1981 
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and  February  1  of  every  second  year 
thereafter. 

(Section  172  of  the  Elementary  and 
Secondary  Education  Act  as  amended  by  the 
Education  Amendments  of  1978) 

***** 

PART  116a~FINANCIAL  ASSISTANCE 
TO  LOCAL  EDUCATIONAL  AGENCIES 
TO  MEET  THE  SPECIAL 
EDUCATIONAL  NEEDS  OF 
EDUCATIONALLY  DEPRIVED  AND 
NEGLECTED  AND  DELINQUENT 
CHILDREN 

2.  Section  116a  is  amended  by  adding 
Subpart  F  to  read  as  follows: 

Subpart  F— Evaluation 

116a.50  Technical  standards. 

116a.51  Local  educational  agency 
evaluation  models:  general. 

116a.52  Requirements  of  the  models. 

116a.53  Alternative  models. 

116a.54  Frequency  of  local  educational 
agency  evaluations. 

116a.55  Local  educational  agency  reporting. 
116a.56  State  educational  agency  reporting. 
116a.57  Allowable  costs. 

Authority:  Title  I  of  the  Elementary  and 
Secondary  Education  Act  as  amended  by 
Pub.  L  95-561,  unless  otherwise  noted. 
***** 

Subpart  F— Evaluation 

§  116a.50  Technical  standards. 

A  local  educational  agency  (LEA) 
shall  explain  in  its  application  how  its 
evaluation  plan  (required  by 
§  116a.22(b)(3))  is  consistent  with  the 
following  technical  standards.  The  State 
educational  agency  (SEA)  shall  use 
these  same  standards  in  determining  the 
adequacy  of  the  LEA’s  plan. 

(a)  Representativeness  of  evaluation 
findings.  The  evaluation  results  are 
computed  so  that  the  conclusions  apply 
to  the  persons  or  schools  served  by  the 
title  1  project.  This  may  be  accomplished 
by  including  in  the  evaluation  either  all 
or  a  representative  sample  of  the 
persons  or  schools  served  by  the  project. 

(b)  Reliability  and  validity  of 
evaluation  instruments  and  procedures. 
The  proposed  evaluation  instruments — 

(1)  Consistently  and  accurately 
measure  the  objectives  of  the  project; 
and 

(2)  Are  appropriate,  considering 
factors  such  as  the  age  or  background  of 
the  persons  served  by  the  project. 

(c)  Evaluation  procedures  that 
minimize  error.  The  proposed 
evaluation  procedures  minimize  error'by 
including — 

(1)  Proper  administration  of  the 
evaluation  instruments: 

(2)  Accurate  scoring  and  transcription 
of  data;  and 


(3)  Use  of  analysis  procedures  whose 
assumptions  are  appropriate  for  the 
data. 

(d)  Valid  assessment  of  achievement 
gains  in  reading,  language  arts,  and 
mathematics.  In  assessing  the 
effectiveness  of  regular  school  year  title 
I  reading,  language  arts,  and 
mathematics  projects  in  grades  2 
through  12,  the  proposed  evaluation 
procedures  yield  a  valid  measure  of  (1) 
the  title  I  children’s  performance  after 
receiving  title  I  services  compared  to  (2) 
an  estimate  of  what  their  performance 
would  have  been  in  the  absence  of  title  I 
services.  As  used  in  this  subpart,  a 
language  arts  project  does  not  include  a 
project  designed  to  teach  English  to  non- 
English-speaking  children. 

(Section  183  of  the  Elementary  and 
Secondary  Education  Act  as  amended  by  the 
Education  Amendments  of  1978) 

S  1 16a.51  Local  educational  agency 
models:  general. 

(a) (1)  An  LEA  shall  use  one  of  the 
models  in  section  116a.52 — or  an 
approved  alternative — in  the  evaluation 
of  each  regular  school  year  title  I  project 
that  provides  instructional  services  in 
reading,  language  arts,  or  mathematics, 
in  grades  2  ^ough  12. 

(2)  The  models  require  that  the  LEA 
administer  a  test  (i)  before  or  at  the 
beginning  of  services  for  the  project 
period  (pretest)  and  (ii)  after  or  at  the 
end  of  the  project  period  (post-test). 
Examples  or  appropriate  pre-  and  post¬ 
test  periods  include  fall-to-fall  testing, 
fall-to-spring  testing,  and  spring-to- 
spring  testing. 

(b) (1)  The  models  compare  the  post¬ 
test  scores  of  title  I  children  to  an 
estimate  of  what  their  post-test  scores 
would  be  if  they  had  not  received  title  I 
services  (“expected  performance"). 

(2)  Each  model  provides  a  different 
method  for  estimating  expected 
performance  using  the  scores  of  children 
not  receiving  title  I  services  who  are 
tested  at  the  same  time  of  year. 

(c)  With  any  of  the  three  models,  the 
LEA  may  use  a  test  with  or  without 
national  norms. 

(Section  183  of  the  Elementary  and 
Secondary  Education  Act  as  amended  by  the 
Education  Amendments  of  1978) 

§  1 16a.52  Requirements  of  the  models. 

(a)  Norm-Referenced  model.  An  LEA 
using  the  Norm-Referenced  model 
shall — 

(1)  Administer  a  pre-  and  post-test  to 
title  I  children;  and 

(2)  Estimate  expected  performance 
using  the  performance  of  children  in  a 
norm  sample  developed  (i)  locally,  (ii) 
by  the  SEA,  or  (iii)  by  a  test  publisher. 


(b)  Comporison  Group  model.  An  LEA 
using  the  Comparison  Group  model 
shall — 

(1)  Identify  a  comparison  group  of 
educationally  disadvantaged  children 
who — 

(1)  Are  similar  to  title  I  children  with 
respect  to  eduationally  relevant  factors 
(such  as  age,  socio-economic  status,  and 
previous  achievement);  and 

(ii)  Are  not  receiving  title  I  or  similar 
compensatory  education  services; 

(2)  Administer  a  pre-  and  post-test  to 
both  the  title  I  children  and  the  children 
in  the  comparison  group;  and 

(3)  Estimate  expected  performance  for 
the  title  I  children  by  using  the  test 
scores  of  the  children  in  the  comparison 
group. 

(c)  Regression  model.  An  LEA  using 
the  Regression  model  shall — 

(1)  Administer  a  pretest  to  a  group  of 
chil^en  in  title  1  eligible  schools  at 
grade  levels  to  be  served  by  title  I.  In  the 
Regression  model  only,  the  pretest  may 
consist  of  a  test,  teacher  judgment  of 
student  performance,  or  a  composite  of 
these; 

(2)  Establish  a  cutoff  score  and 
provide  title  I  services  to  those  children 
scoring  below  the  cutoff.  Children 
scoring  above  the  cutorf  are  the 
comparison  group  for  the  evaluation; 
and 

(3)  Administer  a  post-test  to  both 
groups  and  estimate  expected 
performance  using  the  pre-  and  post-test 
scores  for  the  comparison  group. 

(Section  183  of  the  Elementary  and 
Secondary  Education  Act  as  amended  by  the 
Education  Amendments  of  1978) 

S 1 16a.53  Alternative  models. 

(a)  An  LEA  may  use  an  alternative  to 
one  of  the  three  models  in  §  116a.52  for 
the  evaluation  of  regular  school  year 
reading,  language  arts,  or  mathematics 
projects  in  grades  2  through  12.  An 
alternative  model  would  provide  a 
method  for  estimating  expected 
performance  that  differs  from  methods 
provided  by  the  three  models. 

(b)  The  use  of  an  alternative  model 
must  be  approved  Rrst  by  the  SEA  and 
then  by  the  Commissioner. 

(c)  To  be  approved,  an  alternative 
model  must  yield  a  valid  measure  of — 

(1)  The  title  I  children’s  performance 
in  reading,  language  arts,  or 
mathematics; 

(2)  Their  expected  performance:  and 

(3)  The  results  of  the  title  I  project 
expressed  in  the  common  reporting 
scale  established  by  the  Commissioner 
for  SEA  reporting  (see  §116a.56(c)(l)). 

(d)  The  request  for  using  an 
alternative  model  may  be  submitted  to 
the  Commissioner  by  the  LEA  or  the 
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SEA  acting  at  the  request  of  one  or  more 
LEAs. 

(e)  The  request  must  indicate  how  Hie 
alternative  model  meets  the  three 
requirements  of  paragraph  (c|. 

(f)  The  Commissioner  responds  to  the 
request  in  writing  within  30  days. 

(Section  183  of  the  Elementary  and 
Secondary  Education  Act  as  amended  by  the 
Education  Amendments  of  1978) 

§1l6a.S4  Frequency  of  local  educational 
agency  evaluations. 

(aKl)  An  LEA  shall  evaluate  the 
effectiveness  of  its  title  I  projects  at 
least  once  ev'ery  three  years  in 
accordance  with  a  schedule  established 
by  the  Commissicmer. 

(2)  This  evaluation  must  include  an 
assessment  of  achievement  gains  of  title 
I  children  compared  to  an  estimate  of 
their  expected  performance  in  the 
absence  of  title  I  services. 

(3)  The  LEA  shall  measure  the 
achievement  gains  over  a  period  of 
approximately  either  nine  or  twelve 
months.  (Examples  of  appropriate 
testing  intervals  include  fall-to-fall 
testing,  fall-to-spring  testing,  and  spring- 
to-spring  testing.) 

(b)  At  least  once  during  the  three-year 
period,  the  LELA  shall  collect  additional 
information  needed  to  determine 
whether  the  achievement  gains 
measured  over  nine  or  tw'elve  months 
are  sustained  over  a  longer  period  of 
time.  (Examples  of  appropriate  testing 
cycles  for  this  long-term  evaluation 
include  fall-spring-fall  testing,  fall-fall- 
fali  testify  and  spring-spring-spring 
testing.  • 

(Section  124  of  the  Elementary  and 
Secondary  Education  Act  as  amended  by  the 
Education  Amendments  of  1978) 

§  1 16a.55  Local  educational  agency 
reporting. 

(a) (1)  An  LEA  shall  report  to  the  SEA 
the  results  of  its  evaluations  conducted 
in  accordance  with  the  schedule 
established  by  the  Commissioner. 

(2)(i)  In  reporting  the  results  of 
measurements  of  educational 
achievement  in  regular  school  year 
projects  in  reading,  language  arts,  or 
mathematics  in  grades  2  through  12,  the 
LEA  shall  use  the  common  reporting 
scale  estalished  by  the  Commissioner 
unless  the  SEA  approves  some  other 
form  of  local  reporting. 

(ii)  if  the  SEA  approves  another  form 
of  reporting,  the  LEA  shall  include 
sufficient  information  to  enable  the  SEA 
to  convert  the  achievement  results  to  the 
common  scale. 

(b)  Unless  requested  by  the  SEA.  the 
l.EA  is  not  required  to  include  in  its 
evaluation  report  the  results  of  the  long¬ 


term  evaluations  required  by 
§  116a.54(b). 

(c)(1)  The  LEA  shall  retain  all  of  the 
data  used  to  devdop  its  report  to  the 
SEA  for  a  period  of  five  years  from  the 
date  of  the  report  or  until  any  pending 
Federal  audit  has  been  resolved. 

(2)  The  data  to  be  retairted  must 
include — 

(i)  A  record  of  all  individual  scores, 
with  an  identifying  code  so  that  pre-  and 
post-test  scores  can  be  matched,  in 
regular  school  year  projects  in  language 
arts,  or  mathematics  in  grades  2  through 
12:  and 

(ii)  The  name,  form,  level,  and  date  (rf 
publication  of  any  tests  administered. 

(Section  183  of  the  Elementary  and 
Secondary  Education  Act  as  amended  by  the 
Education  Amendments  of  197^ 

§  1 16a.56  State  educational  agency 
reporting. 

(a)  Sampling  plan.  An  SEA  shall 
submit,  for  the  approval  of  the 
Commissioner,  a  proposed  sampling 
plan  designed  to  ensure  that  evaluations 
are  conducted  in  a  representative 
sample  of  its  LEA's  in  any  school  year. 
The  proposed  plan  shall  be  developed 
according  to  the  schedule  and  criteria 
specified  by  the  Commissioner. 

(b)  Annual  performance  report.  To 
provide  nationwide  information  about 
the  recipients  of  tide  1  services  and  the 
types  of  services  delivered,  the  SEA 
shall  provide,  in  its  annual  performance 
report  the  following  information  for  all 
regular  and  summer  projects  for  ail,  or  a 
representative  sample  of,  LEA's: 

(1)  The  number  of  title  I  participants 
by  t^e  of  services  received: 

(2)  The  number  of  participants,  by 
grade,  who  attend  public  schools:  and 

(3)  The  number  of  participants,  by 
grade,  w'ho  attend  nonpublic  schools: 
and 

(4)  Other  infoimation  requested  by  the 
Commissioner.  (This  may  include,  for 
example,  information  about  Parent 
Advisory  Councils  and  teacher  training.) 

(c)  Biennial  evaluation  report  The 
SEA  biennial  evaluation  report  (required 
by  §  116.7(a))  shall  contain  information 
about  programs  and  projects  conducted 
since  the  last  report.  To  provide 
nationwide  information  about  the  , 
effectiveness  of  regular  school  year 
projects  offering  instructional  services  in 
reading,  language  arts,  or  mathematics 
in  grades  2  through  12,  each  SEA  shall 
include  the  following  information  for  all 
or  a  representative  sample  of  LEAs: 

(1)  A  statewide  average,  by  grade 
level,  of  achievement  gains  resulting 
from  title  I  participation,  expressed  in 
the  common  reporting  scale  estabiislted 
by  the  Commissioner. 


(2)  For  a  sample  of  grade  levels, 
information  by  grade  level  relating 
levels  of  achievement  gain  to— 

(i)  The  number  of  hours  of  project 
exposure; 

(ii)  The  pupil-per-instnictor  ratio:  and 

(iii)  Project  enrollment. 

(3)  If  applicable,  the  number  of 
projects  excluded  because  of  erroneous 
or  missing  data  and  the  reasons  for  their 
exclusion. 

(d)  The  SEA  shall  retain  ail  the  data 
used  to  develop  its  report  for  a  period  of 
five  years  from  the  date  of  the  report  or 
until  any  pending  Federal  audit  has 
been  resolved. 

(Sections  172  and  183  of  the  Elementary  and 
Secondary  Education  Act  as  amended  by  the 
Education  Amendments  of  1978;  45  CPR 
74.82) 

§  116a.57  Allowable  coats. 

(a)  Title  I  funds  may  be  used  Cor 
evaluation  activities  to— 

(1)  Identify  specific  strengths  and 
weaknesses  of  a  project, 

(2)  Determine  the  results  of  a  project; 
and 

(3)  Disseminate  the  results  of  title  I 
evaluations. 

(b)  In  addition  to  the  requirements 
concerning  the  supplementary  nature  of 
title  I  funds  (§  116.40),  other  rules 
governing  title  I  expenditures 

(§  116a.22(b)(4)(ii)  and  (iii)),  and 
Appendix  C  of  45  CFR  74.  the  following 
rules  apply  to  the  use  of  tide  1  funds  to 
support  the  purchase,  administration, 
scoring,  and  analysis  of  evaluation 
instruments.  Except  for  cases  in  which 
data  meeting  these  needs  are  already 
available,  title  I  funds  may  be  used — 

(1)  To  test  tide  1  partici)>ants  for 
evaluation  purposes: 

(2)  In  the  Comparison  Group  model  to 
test  an  appropriate  number  of 
educationally  disadvantaged  children 
who  are  at  the  same  grade  ldvel(s)  as 
title  1  participants,  but  who  are  not 
receiving  title  I  services; 

(3)  In  die  Regression  model,  to  test  an 
appropriate  number  of  children  in  title  1 
eligible  schools  who  are  at  the  grade 
levels  served  by  title  I; 

(4)  In  cases  in  which  a  test  without 
national  norms  has  been  used  for 
evaluation  purposes,  to  administer  to  aU. 
or  a  representative  sample  of  title  I 
participants,  a  test  with  national  norms. 
This  will  permit  the  LEA  or  SEA  to 
convert  its  evaluation  results  to  the 
common  scale;  and 

(5)  To  test  an  appropriate  number  of 
children  no  longer  receiving  tide  I 
services  to  determine  whether 
achievement  gains  measured  over  nine 
or  12  months  are  sustained  over  a  longer 
period  of  time  (as  required  by 

§  116a.54(b)). 
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(c)  Title  1  funds  may  not  be  used  for — 

(1)  General  districtwide  or  statewide 
testing  programs; 

(Z)  Establishing  local  or  State  norms; 
or 

(3)  Research  and  development 
activities,  such  as  the  development  and 
field  testing  of  new  instruments. 

(Section  183  of  the  Elementary  and 
Secondary  Education  Act  as  amended  by  the 
Education  Amendments  of  1978}  ' 

Appendix 

The  foikming  is  a  summary  of  comments 
received  on  the  Notice  of  Proposed 
Rulemaking.  Each  comment  is  followed  by  a 
response  that  indicates  any  changes  made  or 
why  no  change  was  considered  necessary. 
The  oomnents  are  arranged  in  the  order  of 
the  regulatory  sections  to  which  they  now 
pertain. 

§  1 16.7  Reports  by  State  educational 
agencies. 

CommenL  One  conunenter  questioned  the 
statutory  basis  for  the  SEA  evaluation  report 

Response.  No  change  has  been  made. 
Section  172  of  title  I  requires  that  "each 
|SEA|  shall  make  to  the  Commissioner .  .  . 
periodic  reports  .  .  .  evaluating  the 
effectiveness  of .  .  .  [title  I  projects] ...  in 
improving  the  educational  attainment  of 
educationally  deprived  children.  .  . 

CommenL  One  commenter  favored,  and 
five  opposed,  the  change  from  an  annual  to  a 
biennial  SEA  evaluation  report  Three 
commenters  questioned  whether  a  biennial 
report  contradicts  section  188(4)  of  title  I, 
which  refers  to  an  annual  evaluation  report. 
Two  commenters  questioned  whether  a 
biennial  SEA  report  would  meet  the  needs  of 
Congress. 

Response.  No  change  has  been  made.  The 
title  I  statute  does  not  clearly  indicate  the 
frequency  with  which  SEAs  are  required  to 
make  evaluation  reports.  For  example, 
section  172 — which  is  concerned  with  SEA 
evaluation  reporting — requires  “periodic" 
reports  to  the  Commissioner.  Section  188  of 
the  Act — which  addresses  the  responsibilities^ 
of  the  ComnuBsioner,  not  the  SEAs — does 
refer  to  an  “annual  evaluation  report.” 

On  the  other  hand,  section  162  provides 
that  the  Commissioner  may  approve  a  State 
application  only  if  the  State  has  complied 
with  Section  435  of  the  General  Education 
Provisions  Act  Section  435  requires  a  State 
to  assure  the  Commissioner  that  it  will 
evaluate  the  effectiveness  of  its  title  1 
program  “at  such  intervals  ...  as  the 
Commissioner  may  prescribe  by  regulation” 
and  then  report  those  evaluation  results. 

The  biennial  reporting  of  evaluation  data  to 
the  Commissioner  is  sufficient  to  allow 
preparation  of  the  biennial  report  to  Congress 
required  by  section  183(g).  In  addition,  the 
Commissioner  believes  the  requirement  of  a 
biennial  SEA  report  to  be  consistent  with  the 
manifest  desire  of  Congress  to  reduce  the 
amount  of  paperwork  imposed  on  grantees. 

CommenL  One  commenter  objected  to  the 
apparent  contradiction  between  the 
requirement  that  SEAs  collect  evaluation 
data  annually  from  a  sample  of  LEAs  but 
report  that  data  biennially  to  the 
Commissioner. 


Response.  No  change  has  been  made.  The 
SEA  evaluation  report  for  projects  conducted 
under  part  A,  subpart  1  of  the  Act  is  required 
biennially  in  order  to  provide  the 
Commisstoner  with  information  needed  to 
prepare  the  biennial  report  to  Congresa 
mandated  by  section  183(g).  On  the  other 
hand,  section  183(b)  of  the  Act  requires  that 
evaluations  be  conducted  annually  in  a 
representative  sample  of  LEAs  in  State. 

CommenL  One  commenter  asked  whether 
the  SEA  biennial  evaluation  report  must 
include  information  from  both — or  merely 
one — of  the  preceding  years. 

Response.  A  change  has  been  made.  To 
ensure  that  sufTicienl  information  is  available 
for  the  Commissioner's  report  to  Congress, 
both  §  116.7  and  116a.56(c)  have  been 
changed  to  clarify  that  the  SEA  biennial 
report  includes  information  from  projects 
conducted  since  the  last  report. 

Thus,  for  projects  conducted  under  part  A. 
subpart  1.  the  SEA  report  will  include 
evaluation  information  from  the  two 
preceding  school  years.  This  will  enable  the 
Commissioner  to  exanune  the 
representativeness  of  data  obtained  in  any 
given  year  and  to  study  trends  in  title  I 
effectivenys  over  a  period  of  several  years. 

It  will  also  allow  mformation  from  every  title 
I  district  to  be  represented  in  a  report  to 
Congress  during  the  legislative  eyrie. 

Comment.  Four  commenters  said  that  the 
January  1  SEA  reporting  date  is  too  earty, 
especially  for  school  districts  and  States 
using  a  fall-to-fall  testing  eyrie.  However,  one 
commenter  said  that  the  current  November 
deadline  was  satisfactory. 

Response.  A  change  has  been  made. 

Section  116.7(a)  now  provides  that  SEAs  must 
submit  their  evaluation  reports  by  February  1 
instead  of  January  1.  *11118  will  provide 
additional  time  for  SEAs  to  prepare  their 
reports  and  will  also  allow  sufTicient  time  for 
the  Commissioner  to  prepare  a  report  to 
Congress.  Of  course,  an  SEA  can  file  its 
evaluation  report  prior  to  the  deadline. 

CommenL  One  commenter  recommended 
that  S  116.7(a)  be  amended  to  eliminate  the 
requirement  that  each  SEA  include  two  LEA 
evaluation  reports  along  with  its  oum  report. 
Another  commenter  noted  that  the  LEAs  with 
the  five  highest  allocations  in  the  State  might 
not  be  in  the  State's  sample  for  the  year 
covered  by  the  evaluation  report 

Response.  A  change  has  been  made,  llie 
requirement  that  an  SEA  include  two  1£A 
reports  with  its  own  report  is  deleted. 

§  1 16a.50  Technical  standards. 

Comment.  Two  commenters  said  that  the 
technical  standards  could  not  be  achieved 
and  should  be  deleted.  However,  a  third 
commenter  said  there  was  no  excuse  for  an 
LEA  not  to  achieve  the  standards,  and  a 
fourth  said  the  standards  were  good. 

Response.  No  change  has  been  ma<le. 
Section  183(b)  of  the  Act  requires  the 
Commissioner  to  “publish  standards  for  Jdie] 
evaluation  of  program  or  project 
effectivness.  .  .  The  four  standards  reflect 
the  characteristics  of  a  good  evaluation. 
Although  many  factors  may  influence  the 
extent  to  whic^  the  standanls  can  be  met  in  a 
particular  situatioa  it  is  important  that 
evaluations  achieve,  to  the  greatest  extent 
possible,  the  goals  implied  by  the  standards. 


CommenL  Two  commenters  said  that  the 
language  of  the  standards  is  too  vague  to 
enforce,  while  another  suggested  changes 
that  would  have  made  them  even  less 
precise.  Four  commenters  raised  specific 
questions  about  the  standards.  Two 
commenters  suggested  other  wording 
changes. 

Response.  No  change  has  been  made.  The 
Commissioner  believes  that  the  technical 
standards  meet  the  requirements  of  section 
183(b)  of  the  Act  and  are  sufficiently  precise 
to  provide  the  guidance  needed.  Of  course, 
the  appropriate  application  of  the  technical 
standards  requires  technical  judgments  by 
the  evaluator,  who  tvill  have  to  consider 
factors  such  as  the  availability  of  test 
instruments  and  the  likely  impact  of  high 
student  attrition  rates. 

Additional  information  concerning  the 
implementation  of  the  standards  is  provided 
in  the  evaluation  section  of  the  policy 
manual.  A  monograph  describing  various 
optional  sampling  procedures  wrill  be 
available  from  the  Office  of  Education  (OE) 
soon.  Staff  members  of  the  regional  technical 
assistance  centers  are  also  available  to 
advise  SEAs  and  LEAs  in  implementing  the 
standards. 

CommenL  Two  commenters  asked  how  the 
technical  standards  would  be  enforced  and 
another  asked  specifically  what  the  SEA's 
obligation  was  to  enforce  the  standards.  One 
commenter  recommended  that  the 
obtain  from  LEAs  assurances  that  their 
evaluation  plans  address  the  standards, 
rather  than  explanations  of  how  these  plans 
address  the  standards. 

Response.  No  change  has  been  made. 
Section  116a. 50  requires  an  LEA  to  explain  in 
its  application  how  its  evaluation  plan 
addresses  the  standards.  *rhi8  information  is 
necessary  for  the  SEA  to  judge  the  adequacy 
of  the  LEA’S  plan. 

SEAs  are  required  by  sections  166  and  167 
of  the  Act  to  monitor  and  provide  technical 
assistance  to  LEAs  on  all  aspects  of  the  title  1 
program,  including  evaluation.  In  additioa 
section  164  of  the  Act  prohibits  an  SEA  from 
approving  an  LEA  application  unless  the 
project  it  describes — including  the  LEA’s  plan 
to  evaluate  that  project — complies  with  the 
title  I  statute  and  regulations. 

§  1 16a.51  Local  educatfonri  agency 
evaluation  modela. 

CommenL  Thirteen  commenters  expressed 
concern  about  technical  aspects  of  the 
evaluation  system,  including  whether  the 
models  will  yield  comparable  data,  whether 
it  is  possible  to  isolate  the  ejects  of  title  I 
participation  from  that  of  other  programs,  and 
whether  the  approach  reflected  in  the  models 
is  appropriate  for  evaluating  compensatory 
education  programs.  Three  commenters  said 
that  the  models  were  sensible  and  would 
help  reduce  errors  in  evaluation. 

Response.  No  change  has  been  made. 
Although  the  models  represent  a  clear 
improvement  over  many  current  title  1 
evaluation  practices  and  procedures, 
technical  questions  remain  that  require 
further  exploration  and  analysis.  OE  is 
continuing  to  study  these  issues  and  will 
review  its  findings  with  representatives  of 
SEAs  and  LEAs  as  results  become  available. 
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Any  necessary  changes  in  the  regulations  will 
be  made  when  new  information  is  available. 

Comment.  Ten  commenters  supported  the 
publication  of  regulations,  but  seven  others 
suggested  that  regulations  be  delayed  or  that 
the  use  of  the  evaluation  models  be  made 
optional  until  all  technical  problems  are 
solved.  Three  commenters  recommended  that 
OE  continue  to  study  the  models  and  revise 
the  regulations  as  new  information  becomes 
available.  Two  other  said  that  the  regulations 
should  contain  an  expiration  date. 

Response.  No  change  has  been  made. 

These  regulations  are  required  by  section  183 
of  the  Act.  The  Commissioner  intends  to 
reconsider,  and.  if  necessary,  revise  these 
regulations  in  three  years  based  on 
information  available  from  analyses  currently 
being  conducted.  In  the  meantime,  data 
resulting  from  the  models  will  be  reported  to 
Congress,  as  required  by  section  183(g). 

Comment.  Two  commenters  said  that  OE 
has  not  identified  the  uses  of  the  data 
collected.  Eight  others  said  that  the  data 
would  not  be  useful  to  LEAs  in  planning  their 
projects. 

Response.  At  the  Federal  level,  data 
resulting  from  the  system  will  be  used  in 
three  ways: 

(1)  To  prepare  reports  mandated  by  law. 

(2)  To  respond  to  questions  from  Congress 
and  other  interested  parties. 

(3)  To  aid  decision  making  in  OE. 

OE  will  prepare  two  reports  using  data 
from  the  models,  as  well  as  from  other 
evaluation  studies.  These  reports  include  the 
biennial  report  to  Congress  required  by 
section  183(g]  of  the  Act,  and  a  portion  of  the 
annual  evaluation  report  to  Congress 
required  by  Section  417  of  the  General 
Education  Provisions  Act. 

From  data  based  on  the  voluntary 
implementation  of  the  models  during  the 
1977-78  school  year,  OE  will  develop  a  report 
that  will  illustrate  the  ways  in  which  data 
resulting  from  the  models  will  be  analyzed 
and  reported  to  Congress.  This  report  will  be 
distributed  to  SEAs  and  LEAs. 

The  evaluation  data  will  also  be  used  by 
OE  to  respond  to  questions  posed  by 
members  of  Congress,  State  administrators, 
university  personnel,  scholars,  and  other 
interested  educators. 

At  the  State  level,  this  evaluation  data  can 
be  used  for  reporting  purposes,  for  identifying 
exemplary  projects  and  programs,  and  for 
reviewing  and  monitoring  LEA  activities.  At 
the  local  level,  the  data  can  be  used  to  assess 
project  effectiveness  and,  in  coordination 
with  other  information,  can  provide  guidance 
for  the  planning  of  future  projects. 

Staff  members  of  the  regional  technical 
assistance  centers  are  available  to  assist 
State  and  local  officials  in  planning  their 
evaluation  activities  to  be  as  useful  as 
possible.  During  the  next  few  years  the 
centers  will  be  placing  an  increasing 
emphasis  on  the  use  of  evaluation 
information  for  program  planning  and 
improvement. 

Comment.  Five  commenters  said  that  the 
models  represent  merely  a  testing  and 
reporting  system  and  will  not  provide 
information  needed  to  relate  project  results  to 
specific  instructional  activities. 

Response.  No  change  has  been  made. 

These  models  and  reporting  requirements 


deal  principally  with  only  the  most  common 
title  I  objectives:  achievement  gains  in 
reading,  language  arts,  and  mathematics. 
SEAs  and  LEAs  are  encouraged  to  design 
evaluation  systems  that,  in  addition  to 
satisfying  Federal  requirements,  include  the 
collection  of  other  information  needed  for 
effective  local  decision  making. 

Comment.  One  commenter  asked  whether 
an  LEA  can  choose  which  model  to  adopt,  or 
whether  the  SEA  can  prescribe  one  model  for 
the  entire  State. 

Response.  No  change  has  been  made. 
Section  183(d]  requires  the  Commissioner  to 
“provide  to  State  educational  agencies, 
models  for  evaluations  of  all  programs 
conducted  under  this  title  .  .  .  Consistent 
with  this  provision  and  with  the  State 
rulemaking  authority  provided  by  section  165 
of  the  Act.  an  SEA  may,  as  a  general  matter, 
require  its  LEAs  to  use  certain  of  the  three 
models  prescribed  by  the  regulations  or  an 
approved  alternative. 

However,  an  SEA's  authority  to  prescribe 
models  for  use  by  LEAs  is  limited  by  the  need 
to  comply  with  the  technical  standards.  Each 
of  the  three  models  requires  different 
implementation  procedures,  and  each  is  more 
appropriate  in  some  situations  than  others.  In 
selecting  an  evaluation  model  for  a  particular 
title  I  project,  an  SEA  or  an  LEA  must 
consider  the  strengths  and  weaknesses  of 
each  model  as  it  would  apply  to  that 
particular  project. 

In  resolving  any  dispute  between  an  LEA 
and  an  SEA  regarding  the  choice  of  an 
evaluation  model,  the  Commissioner 
considers  the  extent  to  which  any  proposed 
model  enables  the  LEA  to  best  comply  with 
the  technical  standards. 

Comment.  Two  commenters  questioned 
whether  LEAs  have  the  expertise  to 
implement  the  requirements,  and  another 
asked  whether  an  LEA  must  have  an 
independent  contractor. 

Response.  Staff  members  of  the  regional 
technical  assistance  centers  are  available  to 
help  SEAs  and  LEAs  in  selecting  a  model  and 
implementing  its  requirements.  An  LEA  is  not 
required  to  have  evaluations  conducted  by  an 
independent  contractor. 

Comment.  Eleven  commenters 
recommended  the  development  of  models 
and  evaluation  procedures  for  other  program 
areas  and  objectives,  including  early 
childhood  education,  education  of  the 
handicapped,  and  parental  involvement 
programs,  as  well  as  student  reactions  to  title 
I  services. 

Response.  No  change  has  been  made.  The 
development  of  models  and  evaluation 
procedures  is  currently  under  woy  for  title  I 
programs  in  early  childhood  education, 
programs  for  migrants  and  the  neglected  or 
delinquent,  and  for  parental  involvement 
programs. 

Comment.  Four  commenters  asked  about 
topics  outside  the  scope  of  the  proposed 
regulations,  such  as  the  role  of  parents  and 
how  needs  assessments  are  to  be  conducted. 

Response.  No  change  has  been  made. 

Issues  such  as  how  needs  assessments  are  to 
be  conducted  and  the  role  of  parents  are 
addressed  in  the  title  I  statute  and  the  Notice 
of  Proposed  Rulemaking  of  June  29, 1979.  44 
FR  38400. 
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Comment.  One  commenter  asked  how 
LEAs  can  appeal  an  evaluation  requirement 
imposed  by  an  SEA. 

Response.  An  LEA  wishing  to  appeal  an 
SEA  action  involving  an  evaluation 
requirement  may  appeal  to  the  Commissioner 
under  the  procedures  of  Section  425  of  the 
General  Education  Provisions  Act. 

§116a.S2  Model  requirements. 

Comment.  Three  commenters  questioned 
the  suitability  of  national  norms. 

Response.  No  change  has  been  made.  The 
regulations  provide  that  if  national  norms  are 
inappropriate  for  a  particular  group  of  title  I 
students,  the  LEA  may  use  locally  developed 
norms  to  determine  expected  performance. 

Comment.  One  commenter  said  that  the 
regulations  concerning  the  Norm-Referenced 
model  should  require  a  separate  test  for 
selection  and  pretest  of  title  I  participants. 
Two  other  commenters  opposed  such  a 
requirement. 

Response.  No  change  has  been  made.  The 
regulations  do  not  require  a  separate  test  for 
selection  and  pretest.  However,  when  the 
same  test  scores  are  used  for  both  purposes, 
an  error — known  as  the  regression  effect 
error — may  occur.  OE  is  currently 
investigating  the  feasibility  of  various 
statistical  corrections  for  this  error. 

Comment.  Three  commenters  expressed 
concerns  about  the  Comparison  Group  model. 
Two  of  the  three  questioned  the  availability 
of  an  appropriate  comparison  group.  The 
other  asked  whether,  if  the  LEA  uses  a  half- 
year  project,  the  number  of  hours  of  project 
participation  must  be  doubled  in  order  to 
ensure  sufficient  project  exposure. 

Response.  No  change  has  been  made.  In 
many  instances,  it  may  be  difficult  for  LEAs 
to  locate  a  suitable  comparison  group.  One 
situation  in  which  the  Comparison  Group 
model  may  be  feasible  is  in  large, 
homogeneous  districts  where  schools  not 
eligible  to  participate  in  title  I  are  similar  to 
those  that  are.  Another  situation  might  be 
one  in  which  a  project  lasts  half  a  year  or 
less.  In  this  case,  children  assigned  to  the 
second  session  could  serve  as  a  comparison 
group  for  those  receiving  title  1  services  in  the 
first  session. 

.  Like  all  title  I  projects,  those  lasting  a  half 
year  or  less  must  satisfy  section  124(d)  of  the 
Act,  which  requires  that  they  be  of  “sufficient 
size,  scope,  and  quality  to  give  reasonable 
promise  of  substantial  progress  toward 
meeting  the  special  educational  needs  of  the 
children  being  served.”  However,  neither  the 
title  I  statute  nor  the  regulations  establish  a 
m'inimum  number  of  hours  of  project 
exposure. 

Comment.  Four  commenters  recommended 
that  the  regulations  permit  the  use  of 
composite  scores  for  student  selection  in 
connection  with  the  Regression  model.  Such 
scores  might  reflect,  for  example,  teacher 
evaluations  of  student  performance. 

Response.  A  change  has  been  made.  The 
use  of  composite  scores  for  student  selection 
in  the  Regression  model  is  technically 
appropriate.  Therefore,  $  116a.52(c)(l)  has 
been  amended  to  clarify  that  composite 
scores  are  permitted. 

Comment.  Three  commenters  expressed 
general  concerns  about  the  Regression  model. 


Federal  Register  /  Vol.  44,  No.  199  /  Friday.  October  12,  1979  /  Rules  and  Regulations 


59157 


and  one  could  not  understand  bow  the  scores 
of  higher-achievuig  children  could  be  used  to 
estimate  the  expected  growth  of  lower- 
achieving  children. 

Response.  No  change  has  been  made.  In 
the  Regression  model,  the  scores  of  high-  and 
low-achieving  children  are  not  compared 
directly.  Rather,  the  pattern  of  pre-  and  post¬ 
test  scores  of  the  higher-achieving  children  is 
used  to  derive  statistically  an  estimate  of  the 
expected  performance  for  children  receiving 
title  1  services.  OE  believes  that  the 
Regression  model  is  technically  sound, 
although  it  is  not  appropriate  for  ail 
situations.  Guidance  concerning  the 
appropriate  use  of  the  model  is  included  in 
the  evaluation  section  of  the  policy  manual, 
as  well  as  in  the  User's  Guide. 

Comment.  Five  commenters  recommended 
that  language  arts  projects  be  defined  to 
exclude  language  programs  whose  purpose  is 
to  teach  English  to  non-English-speaking 
children. 

Response.  A  change  has  been  made.  As 
used  in  subpart  F,  language  arts  projects  do 
not  include  projects  designed  to  teach  English 
to  non-English -fpea king  children.  Data 
resulting  from  the  evaluation  of  these  projects 
would  not  be  comparable  to  data  from  other 
project  evaluations. 

Comment.  Four  commenters  said  the 
models  discourage  criterion-referenced — or 
other  non-normed — tests  by  requiring  that 
data  1m!  converted  to  the  commtMi  reporting 
scale.  However,  one  commenter  considered 
the  permissibility  of  these  tests  to  be  a 
positive  feature  of  the  models.  One 
commenter  expressed  concern  about  the 
availability  of  tests  that  measure  certain 
types  of  program  objectives. 

Response.  No  change  has  been  made.  With 
any  of  the  models,  the  LEA  may  use  either  a 
normed  or  a  non-normed  test.  LEAs  are 
encouraged  to  select  the  test  that  most 
accurately  measures  the  extent  to  which 
project  objectives  are  achieved.  If 
appropriate  instruments  are  not  commercially 
available,  the  LEA  may  use  a  locally- 
developed  test  designed  to  measure  its 
project  objectives.  (Note,  however,  that 
§  n6a.57(c)  prohibits  the  use  of  title  I  funds 
for  test  development.)  Whenever  non-normed 
tests  are  used,  the  LEA  must  also  obtain 
information  needed  to  convert  the  resulting 
data  to  the  common  reporting  scale 
(§  116a.55(a)). 

Comment.  One  commenter  asked  whether 
LEAs  are  required  to  use  the  models  in  a  year 
when  they  are  not  required  by\he 
Commissioner's  schedule  to  conduct  an 
evaluation. 

Response.  No  change  has  been  made.  The 
regulations  require  LEAs  to  use  the 
evaluation  models  only  for  evaluations 
conducted  according  to  the  Commissioner's 
schedule  (section  124(g)(1)  of  the  Act). 

Comment.  One  commenter  said  that  fall 
testing  should  not  be  required. 

Rf;sponse.  No  change  has  been  made.  The 
testing  cycle  selected  by  the  LEA  will 
determine  when  tests  are  to  be  given.  If  an 
LEA  is  on  a  spring-to-spring  cycle,  for 
example,  fall  testing  would  not  be  required. 

§  116a.53  Atternative  models. 

Comment.  Several  commenters  favored 
permitting  the  use  of  alternative  models. 


although  one  recommended  the  publication  of 
guidelines  for  their  development.  Three 
commenters  said  that  alternative  modeb 
should  not  be  linuted  to  those  that  yield 
results  that  can  be  expressed  in  the  Conunon 
reporting  scale.  Five  commenters 
recommended  State  approval  of  alternative 
models. 

Response.  No  change  has  been  made.  To 
ensure  that  data  resultipg  from  the  modeb 
are  comparable,  as  required  by  section  183(f) 
of  the  Act.  alternative  models  must  be 
approved  by  both  the  SEA  and  the 
Commissioner  and  must  yield  results  that  can 
be  expressed  in  the  common  reporting  scale 
(§  116a.56(c)).  Additional  information 
concerning  alternative  models  is  provided  in 
the  evaluation  section  of  the  title  1  policy 
manual. 

§  1 16a.54  Frequency  of  local  educational 
agency  evaluations. , 

Comment.  Twelve  commenters 
recommended  that  LEA  evaluations  be 
required  annually.  Two  others  recommended 
that  annual  LEA  evaluations  be  either 
encouraged  or  permitted.  Three  commenters 
recommended  other  evaluation  cycles.  On  the 
other  hand,  one  commenter  approved  of  the 
three-year  cycle,  and  another  said  that  LEAs 
do  not  need  to  evaluate  as  often  as  once 
every  three  years. 

Three  commenters  questioned  whether  the 
requirement  of  three-year  evaluations  is  in 
accord  with  section  127(b]  and  other  sections 
of  the  Act  concerning  the  use  of  evaluation 
data  for  project  improvement  and  approval. 

Response.  No  change  has  been  made. 
Section  121  of  the  Act  permits  LEAs  to 
participate  in  title  1  on  the  basis  of  a  three- 
year  application.  Section  124(g)  of  the  Act 
requires  LEAs  to  conduct  evaluations 
according  to  the  schedule  established  by  the 
Commissioner,  but  not  less  frequently  than 
every  third  year. 

The  Conference  Report  that  accompanies 
the  Education  Amendments  of  1978  clarifies 
that  Congress  intended,  in  the  main,  to 
require  LEA  evaluations  no  more  often  than 
once  every  third  year  (Conf.  Report  No.  95- 
1753,  95th  Congress.  2nd  Session,  at  256,  264). 
Of  course.  LEAs  may  evaluate  their  projects 
more  frequently  than  required  in  order  to 
meet  information  needs  for  local  decision 
making. 

Comment.  Although  one  commenter 
favored  the  long-term  evaluation,  several 
others  objected  to  iL  Four  commenters  said 
that  the  long-term  evaluation  should  be 
optional.  Twelve  other  commenters  said  that 
the  requirement  for  a  third  data  point  is  not 
necessary. 

Response.  No  change  has  been  made. 
Section  124(g)(2)  of  the  Act  requires  LEAs  to 
collect  measurements  of  educational 
achievement  in  basic  skilb  over  at  least  a 
twelve-month  period  in  order  to  determine 
whether  regular  school  year  programs  have 
sustained  effects  over  the  summer. 

In  order  to  determine  whether  the  effects  of 
a  project  are  sustained,  it  is  necessary,  first, 
to  examine  the  effectiveness  of  the  project 
after  its  completion,  and  second,  to  collect 
information  about  subsequent  student 
achievement  when  project  services  are  no 
longer  provided.  Section  124(k)  of  the  Act 


requires  LEAs  to  consider  this  information  in 
developing  subsequent  programs  and 
projects. 

Comment.  Two  commenters  said  the 
requirements  for  the  long-term  evaluation 
should  be  more  stringenL  Four  commenters 
said  that  mobility  and  high  attrition  would 
make  long-term  investigations  difficult,  and 
one  said  that  LEAs  would  not  find  the 
information  useful.  One  commenter  said  there 
should  be  some  provision  for  SEA 
enforcement  and  technical  assistance  in  this 
area. 

Response.  No  change  has  been  made.  As 
the  preamble  to  the  proposed  regulations 
explained,  the  intent  of  the  long-term 
evaluation  is  to  provide  information  for  LEAs 
to  use  in  planning  projects  that  will  result  in 
long-term  benefits  fur  participating  children. 
LEAs  are  required  to  use  this  information  in 
their  subsequent  project  planning  (section 
124(k)). 

It  is  important  that  LEAs  conduct  the  long¬ 
term  evaluations  in  a  maetier  that  will  be 
most  useful  for  their  local  planning,  and  the 
establishment  of  uniform  and  possibly 
restrictive  procedures  for  these  evaluations  is 
not  appropriate.  However,  suggestions 
concerning  the  conduct  of  these  evaluations 
will  be  provided  in  the  evaluation  section  of 
the  policy  manual. 

SEAs  are  required  by  sections  166  and  167 
of  the  Act  to  monitor  and  provide  technical 
assistance  to  LEAs  on  all  aspects  of  title  I 
projects  and  services,  including  evaluation.  In 
addition,  the  regional  technical  assistance 
centers  are  available,  on  request  to  provide 
technical  assistance  to  SEAs  and  LEAs  in  the 
design  of  long-term  evaluations. 

Comment.  Four  commenters  said  that 
information  from  the  long-term  evaluations 
should  be  reported  to  the  State  and  Federal 
governments.  One  commenter  recommended 
that  the  regulations  clarify  that  the  long  term 
evaluations  do  not  have  to  be  included  in  the 
LEA  evaluation  report. 

Response.  A  change  has  been  made. 

Section  116a.55(b)  clarifies  that,  unless 
requested  by  the  SEA.  the  results  of  long-term 
evaluations  do  not  have  to  be  included  in  the 
LEA  evaluation  report.  The  purpose  of  the 
long-term  evaluation  is  to  provide  LEAs  with 
information  needed  for  local  project  planning. 
No  uniform  procedures  are  prescribed  for  the 
long-term  evaluations;  therefore.  State  and 
national  summaries  of  the  resulting  data 
would  not  be  feasible. 

§  116a.S5  Local  educational  agency 
reporting. 

Comment.  One  commenter  favored  the  use 
of  the  normal  curve  equivalent  (NCE)  scale  as 
the  common  reporting  scale,  while  another 
preferred  grade  equivalent  scores.  Four 
commenters  said  that  NCEs  are  hard  to 
interpret  to  lay  audiences,  and  three 
requested  guidance  regarding  the  size  of  NCE 
gain  that  would  be  considered  educationally 
significant.  One  commenter  recommended 
that  SEAs  convert  the  data  to  the  common 
reporting  scale. 

Response.  No  change  has  been  made.  The 
technical  properties  of  the  NCE  scale, 
including  the  size  of  gain  that  would  be 
considered  educationally  significant,  are 
currently  under  study.  When  available. 
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results  of  this  analysis  will  be  shared  with 
SFAs  and  I-EAs. 

In  reporting  data  for  their  own  purposes, 
SFAs  and  LEAs  are  not  required  to  use  the 
common  reporting  scale,  but  may  use 
percentiles  or  other  scales.  If  NCE  reporting 
is  desired,  staff  members  of  the  technical 
assistance  centers  are  available  to  assist  in 
the  interpretation  of  evaluation  results.  With 
prior  State  permission,  an  LEA  may  submit 
the  necessary  information  to  the  SEA.  which 
will  then  make  the  conversion  of  data  to  the 
common  scale  (§  116a.55(a)). 

Comment.  Four  commenters  said  that 
maintaining  individual  data  on  title  I 
participants  for  five  years  is  too  burdensome. 
Another  said  that  SEAs  should  keep  the 
records. 

Response.  No  change  has  been  made. 
Section  116a.55(c)  requires  that  individual 
scores  be  kept  so  that  the  data  can  be 
examined  subsequently  for  quality  control 
purposes,  if  necessary.  An  SEA  is  similarly 
required  by  §  116a.56[d)  to  retain  for  a  period 
of  Five  years  all  the  data  used  to  develop  its 
report.  These  record  keeping  requirements 
are  authorized  by  Section  437  of  the  General 
Education  Provisions  Act. 

§  1 16a.56  State  educational  agency 
reporting. 

Comment.  One  commenter  said  the 
regulations  should  specify  how  often  the  SEA 
must  submit  a  sampling  plan. 

Response.  No  change  has  been  made. 
Section  124(g]  of  the  Act  requires  LEAs  to 
evaluate  the  effectiveness  of  their  programs 
according  to  the  "evaluation  schedule 
promulgated  by  the  Commissioner.”  Section 
183(b]  requires  the  Commissioner  to  “develop 
...  a  schedule  for  conducting  evaluations 
.  .  .  designed  to  ensure  that  evaluations  are 
conducted  in  representative  samples  of  the 
local  educational  agencies  in  any  State  each 
\ear.’' 

After  consultation  with  representatives  of 
SEAs  and  LEAs.  OE  issued  a  Title  I  Program 
Directive  (INST.  L  212.4],  dated  February  13, 
1979,  which  provided  guidance  to  SEAs  in 
developing  an  evaluation  schedule  for  their 
States.  This  directive  covered  the  three-year 
evaluation  cycle  from  1979  to  1982.  At  the  end 
of  this  cycle.  OE  will  again  consult  with  SEAs 
and  LEAs  regarding  plans  for  the  next  three- 
year  cycle  of  the  evaluation  schedule. 

Comment.  Several  commenters  requested 
clarification  regarding  SEA  reporting 
requirements.  One  recommended  that  the 
phrase  "achievement  scores"  in 
§  116a.56(c}(l)  be  changed  to  achievement 
gains,  because  it  is  gain  scores  that  are 
actually  reported.  Another  asked  whether 
evaluations  of  summer  projects  are  to  be 
included. 

Four  other  commenters  made  suggestions 
regarding  how  the  data  should  be  reported, 
such  as  reporting  separately  for  children  who 
were  promoted  and  for  children  who  were 
retained  in  grade,  and  for  children  in  public 
and  non-public  schools. 

Response.  A  change  has  been  made.' 
Section  116a.56(c)(l)  was  changed  to  indicate 
that  an  SEA  is  to  report  a  statewide  average 
of  achievement  gains,  rather  than 
achievement  scores,  resulting  from  title  I 
participation. 


Results  from  summer  project  evaluations 
need  not  be  included  in  the  SEA  report. 
Section  116a.56(c)  requires  achievement  data 
pertaining  only  to  “regular  school  year 
projects.”  Additional  claribcation  about  data 
collection  and  reporting  will  be  provided  in 
the  instructions  accompanying  the  SEA 
reporting  form  and  in  the  evaluation  section 
of  the  policy  manual. 

Comment.  Six  commenters  said  that  the 
regulations  impose  an  increased  data 
collection  and  reporting  burden  on  SEAs  and 
LEAs,  although  two  said  the  regulations 
decrease  that  burden.  Three  commenters 
recommended  that  OE  not  request  certain 
types  of  information,  such  as  information 
relating  achievement  gains  to  hours  of 
instruction  or  pupil-per-instructor  ratio.  One 
commenter  suggested  that  there  be  a  deadline 
for  specifying  any  other  information  that 
might  be  requested  by  the  Commissioner. 

Response.  A  change  has  been  made.  The 
Commissioner  believes  that  the  data 
reporting  requirements  imposed  by  the 
regulations  represent  a  reasonable  balance 
between  the  need  to  provide  Congress  with 
important  information  about  the  effectiveness 
of  title  I  and  the  need  to  keep  the  data 
collection  burden  for  SEAs  and  LEAs  at  a 
minimum. 

In  response  to  suggestions  received, 

S  116a.56(c)(2)  now  requires  information 
relating  achievement  gain  to  hours  of 
instruction  and  other  variables  for  only  a 
sample  of  grade  levels.  This  will  reduce  the 
data  reporting  burden  but  still  enable  the 
Commissioner  to  report  to  Congress  on  how 
iipportant  factors  such  as  hours  of  instruction 
are  related  to  student  achievement  gain  in 
title  I  projects. 

An  announcement  describing  the 
information  to  be  contained  and  the  reporting 
scale  to  be  used  in  the  SEA  report  covering 
each  school  year  will  be  published  in  the 
Federal  Register  by  February  15  of  the 
preceding  year,  as  required  by  Section  400A 
of  the  General  Education  Provisions  Act. 

Comment.  Three  commenters  said  that  a 
performance  report — required  by 
§  116a.56(b} — based  on  a  sample  of  LEAs 
would  not  be  adequate,  and  two  others 
recommended  that  a  performance  report 
based  on  all  LEAs  be  submitted  biennially. 
One  commenter  questioned  the  legal 
authority  for  the  performance  report. 

Response.  No  change  has  been  made.  An 
annual  performance  report  is  currently 
required  by  the  General  Education  Provisions 
Act  Regulations  (45  CFR  lOOb.432).  An  annual 
performance  report  will  be  required  by  the 
Department's  Administration  of  Grants 
Regulations  (45  CFR  74.82).  This  will  apply  to 
title  I  through  incorporation  in  the  Education 
Division's  General  Administrative 
Requirements  (EDGAR),  which  have  been 
published  as  a  Notice  of  Proposed 
Rulemaking  (44  FR  26298).  These  provisions, 
in  turn,  are  required  by  OMB  Circular  A-110. 

For  the  SEA  report  to  the  Commissioner — 
required  by  §  116a. 56(b] — a  performance 
report  based  on  a  representative  sample  of 
L^s  is  considered  adequate.  An  SEA  may, 
under  section  127(b)  of  the  Act.  require 
additional  performance  reporting  if  this 
reporting  is  needed  by  the  SEA  to  perform  its 
administrative  duties. 


§  1 16a.57  Allowable  Costs. 

Comment.  Two  commenters  said  that 
money  to  support  evaluation  activities  will 
have  to  come  from  program  funds,  and  two 
others  complained  that  no  additional 
administrative  funds  are  being  provided  to 
SEAs  to  fulfill  their  evaluation  functions.  One 
commenter  expressed  concern  that  LEA 
evaluation  funds  may  be  decreased  because 
of  the  reduction  in  required  LEA  evaluations. 

Response.  No  change  has  been  made. 
Section  172  of  the  Act  requires  SEAs  to 
collect  and  report  evaluation  data.  This  is 
merely  one  of  the  administrative  duties  of 
SEAs  for  which  they  are  entitled  to  receive 
funds  under  section  194  of  the  Act. 

At  the  local  level,  section  124  of  the  Act 
requires  LEAs  to  conduct  evaluations  and  to 
utilize  the  results  of  these  evaluations  in 
subsequent  program  planning.  In  general, 
evaluations  are  required  only  every  third 
year.  However,  an  LEA  may  conduct  annual 
evaluations  if  they  are  needed  for  program 
planning  and  improvement.  The  LEA  would, 
of  course,  have  to  justify  those  evaluation 
activities  in  its  application  to  the  SEA.  Both 
OE  and  staff  members  of  the  technical 
assistance  centers  will  work  with  SEAs  and 
LEAs  to  make  the  required  data  collection 
activities  as  efficient  as  possible. 

Comment.  Some  commenters  said  that  the 
proposed  regulations  place  undue  restrictions 
on  the  use  of  title  I  funds.  Seven  commenters 
said  that  LEAs  should  be  able  to  use  title  I 
funds  for  selection  of  children  to  participate 
in  title  I  and  for  research  purposes  such  as 
the  development  of  local  norms. 

Two  respondents  said  that  the  regulations 
should  permit  title  I  funds  to  be  used  for 
training  parents  in  evaluation  procedures. 
Another  said  title  I  funds  should  be  permitted 
to  cover  the  cost  of  preparing  and  submitting 
evaluation  data  to  the  Federal  Joint 
Dissemination  Review  Panel  for  the  approval 
of  exemplary  projects. 

Response.  No  change  has  been  made.  The 
regulations  continue  the  current  policy  that 
title  I  funds  may  not  be  used  for  selection  of 
title  I  participants — except  if  the  Regression 
model  is  used — or  for  research  and 
development  activities,  including  the 
development  of  local  norms  and  test 
development. 

The  LEA  may  use  title  I  funds,  however,  for 
the  collection  and  analysis  of  information 
needed  for  the  evaluation  report  and  for  the 
interpretation  and  dissemination  of 
evaluation  findings.  The  LEA  may  also  use 
title  I  funds  for  the  development  of  reporting 
forms  that  are  needed  to  collect  achievement 
data  or  other  similar  information  about  the 
project. 

Allowable  costs  for  parent  training  in 
evaluation  and  other  parent  activities  will  be 
addressed  in  a  revision  of  other  parts  of  the 
title  I  regulations,  which  will  be  published 
soon.  Examples  of  evaluation  activities  that 
may  be  funded  with  title  I  funds  are  provided 
in  the  evaluation  section  of  the  policy 
manual. 

Comment  Three  commenters 
recommended  that  LEAs  be  permitted  to  use 
title  I  funds  to  test  children  no  longer 
receiving  title  I  services  in  order  to  meet  the 
long  term  evaluation  requirements  of 
§  116a.54(b). 
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Response.  A  change  has  been  made. 

Section  116a.57(b)(S)  permits  title  I  funds  to 
be  used  to  determine  whether  achievement 
gains  measured  over  nine  or  twelve  months 
are  sustained  over  a  longer  period  of  time,  as 
required  by  S  116a.54(b). 

Comment.  Five  commenters  were  , 
concerned  about  the  use  of  title  I  funds  for 
testing  non-title  I  students.  One  of  them 
recommended  that  LEAs  be  required  to 
provide  assurances  that  these  funds  would 
not  be  misused.  Three  others  suggested 
changes  to  limit  the  number  of  non-title  I 
children  who  could  be  tested.  One 
commenter  asked  whether  all  students  in  the  > 
district  could  be  tested  with  the  Regression 
model  Another  requested  clarirication  of  the 
phrase  "except  where  data  meeting  these 
needs  is  already  available.” 

Response.  A  change  has  been  made. 

Section  116a.57(b)(2)  and  (3)  now  provide  that 
with  the  Comparison  Croup  and  Regression 
models,  an  appropriate  number  of  non-title  I 
participants  who  are  at  the  same  grade  levels 
as  the  participants  may  be  tested  with  title  I 
funds.  Although  the  speciHc  number  of  non¬ 
title  I  participants  needed  for  these  models 
may  vary  with  the  situation,  the  LEA  is 
expected  to  test  no  more  non-title  I 
participants  than  it  requires  to  obtain  a  valid 
estimate  of  expected  performance. 

Testing  of  non-title  I  participants  is 
acceptable  only  If  no  information  is  available 
concerning  children  who  could  serve  as  a 
comparison  group  for  these  models,  or  if  the  ■ 
available  information  would  not  meet  the 
evaluation  needs  because  of  factors  such  as 
non-comparable  tests  or  testing  times. 
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